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Locating the source of odor in a turbulent 
environment — a common behavior for liv- 
ing organisms — is non-trivial because of the 
random nature of mixing. Here we analyze 
the statistical physics aspects of the problem 
and propose an efficient strategy for olfactory 
search which can work in turbulent plumes. 
The algorithm combines the maximum likeli- 
hood inference of the source position with an 
active search. Our approach provides the the- 
oretical basis for the design of olfactory robots 
and the quantitative tools for the analysis of 
the observed olfactory search behavior of liv- 
ing creatures (e.g. odor modulated optomotor 
anemotaxis of moth). 

Olfactory search strategies are interesting because 
of their relevance to animal behavior jj], ^, |^, ^, ||, |(| 
and because of their potential utility in practical ap- 
plications (such as searching for chemical leaks, drugs 
and explosives [^J). Both, the attempt to character- 
ize and understand the olfactory behavior of living 
organisms @, [| H § g, |] and the more recent ef- 
fort to design and build "sniffing machines" — robots 
that navigate using odors as a guide (2?], |6[ ^oj 
face the common problem of understanding how the 
information gained from sporadic detection of odor 
dispersed in a naturally turbulent flow can be effi- 
ciently utilized for locating the source. Here we shall 
discuss the statistical aspects of turbulent odor dis- 
persal and propose a novel and well defined search 
algorithm, which we shall first define in the context 
of a simplified model of the turbulent plume and later 
restate in the form applicable to natural environment. 
The proposed search algorithm can be used in robotic 



applications and provides a plausible algorithmic in- 
terpretation for aspects of insect olfactory search be- 
havior. 

The most familiar strategy for locating the source 
of a substance is chemotaxis [Q, |30) which consists 
of motion in the direction of the local concentration 
gradient. Chemotaxis works on small scales, where 
the substance spreads by diffusion and the field of 
concentration is smooth which is appropriate to the 
environment of bacteria, amoebae or single eukary- 
otic cells |50[ On the other hand, larger animals 
tracing odors in turbulent flows, e.g. in atmosphere, 
have to deal with the complex fluctuating structure 
of the odor plume caused by the randomness in the 
flow which disperses it. This makes the search a 
much more complex task. The odor is not always 
present and when it is detected, the local concen- 
tration gradient typically does not point toward the 
source pi ^, [ll[] . A more complex strategy is re- 
quired and additional information such as the current 
wind direction (and velocity) is very valuable. One 
of the best characterized olfactory search behaviors is 
the " odor-modulated optomotor anemotaxis" , which 
is employed by males of certain species of moths (see 
ID, [|]) in order to locate the source of a pheromone 
(i.e. potential mate), and which involves, in addition 
to the sense of smell, the ability to determine the wind 
direction*. The moth's olfactory pursuit flight ex- 
hibits a counterturning pattern: a succession of turns 
alternatively to left and right with respect to the wind 
direction^. Counterturning is further classified as i) 
casting and ii) zigzagging [l6| [l7|, [l8) . The two dif- 
fer in the extent of upwind progression: "zigzagging" 
is counterturning with a significant resultant move- 



* Moths determine instantaneous direction of wind visually by looking at the motion of objects on the groundi when the 
moth is heading upwind its body axis is aligned with the direction of motion of the objects (see C. T. David, Rcf.[lJ, p. 49). 

tit has been found that counterturns are self-steered as opposed to gradient-steered jl^, u|, which is to say that the moth 
makes each turn not because it reaches the boundary of the plume and feels the lateral gradient of the concentration, but due 
to internal turn generator which alternates between right and left. 



merit upwind, while "casting" is counterturning with 
no upwind progression but with wider cross-wind ex- 
cursion. Casting and zigzagging behavior has been 
interpreted [jl5| [l6| as a strategy consisting of up- 
wind progression in the presence of odor (zigzagging) 
and cross-wind flight in its absence (casting). Most 
generally the two behavioral patterns may be under- 
stood in terms of 'exploitation' and 'exploration' |32[ : 
the former utilizes the available information, the lat- 
ter attempts to collect it. Below we shall identify the 
quantitative considerations which provide the ratio- 
nal basis for this type of behavior in the context of 
the olfactory search. 

Let us first discuss the properties of odor plumes 
in turbulent flows [l| [H]. If one measures the 
concentration of odor far enough downwind of the 
source, most of the time no odor will be detected 
H . When an odor patch arrives it is detected as a 
burst with a complicated small-scale structure, as lo- 
cal concentration fluctuates strongly while the patch 
is passing by. The maximal amplitude of the concen- 
tration within such a patch decreases away from the 
source, and the average time between two successive 
patches increases 1 ''. The probability of encountering 
an odor patch at any given point is determined by 
the statistics of the flow. The mean velocity (and 
direction) of the wind, V, is set by the large-scale at- 
mospheric conditions and hence stays unchanged for 
periods of time long compared with the time-scale 
of odor fluctuations. The material points, and thus 
odor molecules, move with the local velocity which 
includes fluctuations about V so that their net mo- 
tion is a random walk (due to velocity fluctuations) 
superimposed on the drift downwind (due to mean 
velocity) . The fluctuations of velocity have a correla- 
tion length, L, which can be estimated as the height 
above the ground (since the height above the ground 
restricts the size of the vortices) |hJ . At scales larger 
than the correlation length L, the motion is effec- 
tively Brownian with the diffusion coefficient given 
by eddy-diffusivity, D |2l| which can be estimated as 
Lu rms , where w rms is the root-mean-square of velocity 
fluctuationsjlO]]. A patch of odor is blown as a whole 
along a Brownian trajectory and is stretched due to 
spatial inhomogeneity of the velocity. The stretch- 
ing produces small-scale variations of the concentra- 
tion of odor which decay due to molecular diffusion. 
Thus, odor patches have a finite life time due to mix- 
ing which occurs abruptly when the smallest scale of 



the patch reaches the Batchelor scale set by molecu- 
lar diffusion 1 1 . Probability of a patch to survive for 
time t in the flow is expected to behave as e - *"™ 3 ^. 
Because the fluctuating component of velocity is typ- 
ically much smaller than the mean, v rrns << V, the 
probability of finding an odor patch at a downstream 
distance much larger than L is still significant. 

This Lagrangian view p"l[ of odor dispersal, in 
terms of relatively long-lived patches of odor exer- 
cising a biased random work, suggests the follow- 
ing model which will help us formulate the key is- 
sues relevant to olfactory search. Consider a square 
two-dimensional lattice. The sites have coordinates 
r = (x,y) and the source is at (0,0). At each time 
step the source releases an " odor patch" which is ad- 
vected by the "wind". The wind velocity can take 
three values: (—1,1), (0,1), and (1,1), so that the 
odor patch moves according to the following rule: 
each time step its y-coordinate increases by 1 and 
cc-coordinate gets incremented by ±1 or stays un- 
changed. The probabilities of the increments —1,0, 
and 1 are p^, po, and £>r. Without loss of generality 
we assume that pl = Po = PR = 1/3 , so that the av- 
erage velocity points along y-axis§ . This model repre- 
sents odor dispersion on the length scale larger than 
the correlation length, L, which corresponds to the 
lattice constant in the model. The three dimensional 
structure of the real plume is not essential, because it 
does not dramatically change the statistical distribu- 
tion of 'patches'. On the other hand, it is natural to 
conduct a two dimensional search (e.g. constant high 
above the ground) at least to within distance L from 
the source. Hence our choice of a two-dimensional 
model. 

Figure [l] shows a snapshot of a plume generated by 
the process described above. If we wait long enough, 
a stationary distribution of patches will be reached, 
which at y 3> 1 has the asymptotic form 
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where D = (p R + p L )/2 is the 'eddy diffusivity'. 
The boundary of the time averaged plume has the 
form | a; | ~ y 1 Dy. The probability to find an odor 
patch at i > VDy is very small. On the other 
hand, at x < \JDy the probability is of the order 
of (AirDy)- 1 / 2 . 

Let us now define the search rules for the model 
plume. A local "observer" (our model moth or a 

••The internal small-scale structure of the odor burst in principle contains some information about the distance from the 
source, but extracting it requires considerably more processing and we shall limit ourselves to considering the whole burst (or 
patch) as a single event. 

§The model can be readily generalized to include the fluctuations of the ^/-component of the velocity. One can also include 
a finite life-time of particles by introducing the probability for the particle to disappear. 
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robot) can detect a) the event of odor patch arrival, 
b) direction from which the patch has arrived. This 
corresponds in reality to the ability to detect instan- 
taneous odor concentration and instantaneous wind 
velocity. Each time step, our robot is able to move at 
most one lattice step along y-axis and/or one lattice 
step along x -axis. For simplicity we will assume that 
the robot does not move downwind, i.e. it does not 
increase its y-coordinate. The search starts after the 
robot contacts an odor patch for the first time. 

Our goal is to find the best search algorithm. An 
algorithm must determine where the robot should 
move at the next moment based on, in principle, all 
prior observations. Each algorithm is characterized 
by the time it takes to find source — the search time. 
Due to random nature of the plume the search time 
is a random quantity. Hence we consider the prob- 
ability distribution function of the search time, p(t), 
given by the probability that the source is found dur- 
ing t, t + 1 interval. For some algorithms the search 
time can be infinite in some realizations of the plume, 
which means the source is never found. Since each al- 
gorithm is characterized by a function, p(t), and not 
by a number, the definition of the optimal algorithm 
is non-unique: one can choose different optimization 
criteria. Below wc shall seek an efficient algorithm in 
the sense of the mean search time. 

First consider a simple strategy, which will help 
to understand the more efficient one. Suppose that 
the robot waits at one site until it gets an odor patch. 
Then it moves to the site from which the patch came. 
This will always lead to the source, i.e. the probabil- 
ity to miss the source is zero for this strategy. It is 
possible to analytically calculate the probability den- 
sity function (PDF) of the search time. Near the peak 
it has the Gaussian form 
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where ro = (xq, yo) is the initial position of the robot, 
and t s is the 'typical' search time. In addition one can 
derive that for t ^S> t s PDF decays as p(t) cx i~ 3 . 

From this expression for the PDF one can see that 
the strategy has severe drawbacks. If the initial po- 
sition is inside of the parabolic region, xo < y/Dyo, 

3/2 

the typical search time goes as y Q . However, from 
outside of the parabolic region xq > \/ Dyo, the 
search time grows with xo faster than exponentially, 

exp ^ 4Dy ) ' wmcn means that the strategy does not 
work well for points away from the plume axis. The 



PDF variance A also increases rapidly with xo and in 
addition the long time asymptotic form of the PDF 
is a power law, p(t) cx t~ 3 , which mean that there 
exists a relatively high probability that the search 
takes much longer than the typical time, t s . This is 
explained by the robot's tendency to get trapped out- 
side of the parabolic region on the way towards the 
source. 

The same drawbacks are inherent to the maxi- 
mum likelihood algorithms |^2|, ^3). In these strate- 
gies one estimates the probability for the source to 
be located at any given point conditional on the his- 
tory of observation and then move in the direction of 
the most likely source location. However, unless one 
waits for a long time so that many particles are ob- 
served, this conditional probability is a flat function 
of coordinates, i.e. many source locations around the 
maximum have approximately the same probability. 
As a consequence, all reliable algorithms of maximum 
likelihood type suffer from the drawbacks described 
above: i) the search time increases rapidly if the ini- 
tial position is shifted outside of the parabolic region 
and ii) the probability that the search takes much 
longer than the mean time is substantial. 

The inefficiency of the passive search algorithms 
is related to a small probability of encountering odor 
patches. To avoid this, one should not waste time 
waiting for odor patches which arrive rarely and in- 
stead actively explore the space. To construct an ef- 
ficient algorithm one should take the following facts 
into consideration, i) If a patch is observed, it is ob- 
vious that the best strategy is to make a step in the 
direction from which it has arrived. Each odor patch 
observation greatly reduces the uncertainty about the 
source position: if (xq, yo) is the position of the odor 
patch one time step ago, the source can only be lo- 
cated in the interior of the cone y — yo = ±(x — xq), 
y < yo (see Fig. ||). ii) The probability to encounter a 
patch at two neighboring sites is almost equal (see Eq. 
(Q). iii) In the absence of a patch, waiting at one site 
brings very little information about the source. On 
the other hand, making one step reduces the uncer- 
tainty of the source location by one point. It follows 
that making a step is always preferable over the wait- 
ing. When moving, all the points in the cone must be 
visited in order not to miss the source. The simplest 
way to do this is to visit all the values of x within the 
cone at given value of y, and then move to y — 1. In 
the above example, we visit the points (xq ± 1, yo — I) 
and (xq, yo ~ 1) and make sure that the source is not 
located (or is located) at one of these points. Af- 
ter these points have been visited, the closest points 
which have to be checked are located at y = yo — 2. 
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Now there are five of them: at x — xo±2 , x — xo±l, 
and x — xq (Fig. ^). This procedure is repeated un- 
til the robot encounters another odor patch. Then 
the number of possible source locations gets greatly 
reduced as the cone of possible positions collapses to 
a new one with the vertex at the point of encounter. 
The cones are nested, so only the position where last 
patch was encountered has to be remembered. 

Figure |^ shows a typical trajectory. Since the 
number of points to be visited is small after hitting a 
particle, and grows thereafter, the amplitude of the 
'counterturns' is small immediately after encounter 
of an odor patch and then grows. The net upwind 
component of the robot velocity is largest after an 
encounter and gets smaller with time as 1/Vt. 

Within our model one can again analytically cal- 
culate the PDF of the search time 

*>-*b-(-^)H)- « 3 » 

with the typical search time 

t s = ayl'\ (4) 

Here, and a, b are constants of the order of one. Most 
significantly and in contrast with the " passive" strat- 
egy considered before, the search time t s is indepen- 
dent of the crosswind coordinate xq , which means 
the search takes approximately the same time even 
if the initial position is outside of the parabolic re- 
gion. This is a consequence of the "counterturning" 
strategy: after the first contact with odor, the robot 
starts to move upwind with increasing cross-wind am- 
plitude, so with a high probability the next patch will 
be encountered inside the region \x\ < \fDy~ (see Fig. 
|3|). The PDF has a sharp maximum at t f=s t s and 
decays exponentially for t^> t s , i.e. the search time 
is approximately the same independently of the real- 
ization of the plume. This is explained by the fact 
that the number of odor patches encountered by the 
robot is relatively small, so most of the time is spent 
exploring points in the cones. Finally, the power-law 
dependence of t s on yo has the exponent 5/4 which 
is smaller than the corresponding exponent 3/2 for 
the passive algorithm, so that even the search which 
starts on the axis of the plume is faster. This can be 
seen in Fig. [|a which compares the histograms of the 
search times obtained by Monte-Carlo simulations of 
the two algorithms. The strong dependence of the 
"passive" search time distribution on xq (note the 
logarithmic scale of in the figure) is evident even for 
moderate \xo\/*/Dyo (Fig. ||b) - simulating a passive 
search which starts further off axis is unreasonably 
time consuming 



Let us now consider a modification of the algo- 
rithm, which further diminishes the search time at 
the expense of a small probability to lose the plume. 
It also allows one to get rid of the lattice and adapt 
the search algorithm to a continuous space. In prin- 
ciple, one should visit all the points in the cone, be- 
cause the source can be at each point with a non-zero 
probability. However, for some points the probabil- 
ity can be quite small. Such points can be omitted 
from the search. Let us disregard the points inside 
the cone for which the probability to find the source 
is smaller than a small constant, p c . Then from Eq. 
(|l|) we obtain a parabolic region 

(x- Xl ) 2 <AD{ yi -y)\n( * ) , (5) 

\p c y/4TrD( yi - y)J 

marked by a dashed line in Fig. |[ The PDF in this 
case has the same form (^) with t s = a^y^ ■ The 
typical search time, t s , has a somewhat weaker de- 
pendence on yo than the other algorithms, however 
there exists a small probability to miss the source. A 
search trajectory for this algorithm is shown on Fig. 
|b. 

Although we have formulated the search algo- 
rithm in terms of a two-dimensional lattice model, 
it is readily generalized to search in real three- 
dimensional turbulent plumes. The characteristic 
length-scale (the analogue of the lattice constant in 
the model) is the correlation length, L set by the 
height above the ground. The search is summarized 
by the following steps: i) detect odor ii) start cross- 
wind counterturning so that upwind progression per 
turn is of the order of L and the transverse ampli- 
tude grows as {Dy/V) 1 / 2 where V is the mean wind 
velocity, D is the eddy diffusivity and y is the up- 
wind displacement from the point of last encounter 
with odor. In this way the robot passes within L 
of any point within the search domain. The up- 
wind projection of the robot's velocity decreases as 
[v 2 L 2 V/(Dt)] 1 ^ 3 , where t is time elapsed since the 
last encounter of odor patch (v is the constant ground 
speed the robot). The number of counterturns de- 
pends on t as [vWKDL)] 1 / 3 . The essential compo- 
nent of the search strategy is the crosswind motion, 
which prevents the searcher from getting trapped in 
the regions of exponentially small probability increas- 
ing the rate with which patches of odor are encoun- 
tered, and hence increasing the rate of information 
acquisition. The resultant transverse motion is bi- 
ased towards the mid-line of the plume because that 
is where odor patches are more frequent. Thus, the 
algorithm could be reformulated as the search for the 
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mid- line of the plume constrained by minimizing the 
probability of overshooting along the longitudinal di- 
rection. 

To conclude, we have proposed an olfactory search 
algorithm designed to function in turbulent flow. 
The efficiency of the proposed algorithm derives from 
the implementation of the 'counterturning' strategy 
which resembles the observed olfactory search behav- 
ior of moths. The parameters of the counterturns, i.e. 
amplitude and upwind drift velocity, are adapted to 
the measurable statistical properties of the flow. This 
algorithm can be readily implemented in a robotic de- 
vice, provided the latter is equipped, in addition to 
a chemo-sensor, with an anemometer to continuously 
measure wind velocity. We have not attempted to rig- 
orously prove the optimality of the proposed search 
algorithm. Doing so would be a worthwhile challenge. 
Last but not least, our quantitative analysis of search 
strategies exposes the role of counterturning and pro- 
vides insight into olfactory search behavior of insects 
and other creatures, ft is likely that zigzagging and 
casting of the moth are not fundamentally different 
but merely correspond to the extremes of a counter- 
turning behavior pq |. Making further comparisons 
between theoretical search algorithms and observed 
search patterns will require new quantitative exper- 
iments with moths in turbulent plumes. The pro- 
posed quantification of the search strategy in terms 
of PDF of search time could be applied in experi- 
mental context. Another potentially interesting av- 
enue of research would pursue the connection between 
the counterturning search and the very general no- 
tion of 'exploration' versus 'exploitation' in learning 
behavior Q. 
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Figure captions: 

Figure 1 A snapshot of the model odor field (y = 100). Dashed line bounds the parabolic region where 
most odor patches are concentrated. Graph on the bottom represents the probability density function of 
patch distribution at y = 100. Arrow indicates the mean wind direction. 

Figure 2 a, An odor patch arriving from P = (x ,y ) detected at R. Circles indicate possible source 
locations inside the 'causality' cone with the vertex at P. Dashed line is the boundary of the parabolic 
region corresponding to relatively high likelihood of source location. The nodes inside the parabolic region 
are shown as filled circles; b, A counterturning trajectory inside the cone. 

Figure3 Typical search trajectories for the two algorithms. The initial position is (20, 100). a, The search 
is performed inside 'causality' cones; b The modified search, where only the points inside the parabolic 
high-likelihood regions are searched. Arrow indicates the mean wind direction. The dashed lines show the 
region of high probability to encounter odor patch. 

Figure 4 Histogram of the search time obtained numerically using Monte-Carlo simulations, a, with initial 
condition (0,50); b, with initial condition (10,50). Solid line shows the histogram for the passive search 
algorithm, dashed line — for the active search algorithm. Note the logarithmic scale of t. 
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